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Open-Source RTOS Considerations SEG 


Open-Source Advantages 


¢ Projects desire to own/control all source code forever 

¢ Not locked into specific vendor/version for many years 

¢ Not locked into proprietary build environment / tools 

¢ Don't have to pay third-party for upgrades / new features 
¢ Successful heritage and flight experience 

¢ No budget for purchases 


Open-Source Barriers 
¢ Unable to be (easily) flight qualified 


¢ No artifacts, little or limited documentation, no test cases 
¢ Lots of internal development/ testing may be needed 
¢ Example: custom drivers 
¢ Nothing is guaranteed to work “out of the box” 
¢ Could require more testing than COTS 
¢ Many forks, no central/core version, fixes/features not fed back to project 


12/8/2017 title of your research 
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Terminology 


¢ Qualification vs Certification 
— The process of developing and documenting quality 
software by utilizing a formal process and artifact 
generation 
¢ Pre-Qualification is jump start on qualification with 
core artifacts and processes @s 
¢ Final “Flight” Qualification 
— Performed on specific flight board/system 


— Qualified to a chosen standard 
¢ Examples: DO178-B/C, NASA 7150.2B 
— Tested and documented 
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JSPR 

Open-Source Qualification Example 
¢ Core Flight System (CFS) Class A Certification 

— Performed by JSC for the Orion Program 

— LEON3/VxWorks 
¢ Certification Included 
— Full coverage UT-assert unit test cases 
— API unit tests 
— Vertical integration tests 


— Test matrix, test plan, procedures, test report 
— VDD, User’s Guide 
— Code inspections, static analysis 
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Research Goals 


¢ Increase the quality and maturity of open-source RTOS by 
identifying a lean, mean, PRE-qualification process 
¢ Process should be driven by standard(s) 
¢ Process has to be simple, not overwhelming, leverage existing / 
free tools, and not scary 


(« 


¢ Processes are scary for open-source projects 
¢ Limited resources 
¢ No time, money, expertise, or manpower 
¢ Not agile — too rigid for open-source paradigm 


7150.2B 
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Nasal Research Goals 


¢ Imagine: FSW Lead on New Mission 
¢ What RTOS? Open-source or COTS? 
¢ IF Open-Source: 
¢ Flight heritage? 
¢ Hardware profiles? LEON3/4, RAD750? 
¢ Maturity? 
¢ Flight Qualification Possible? 


¢ Maturation Metrics 
¢ How to measure maturity? 
¢ How to measure software quality? 


¢ Choose open-source RTOS that is pre-qualified Pye-Qualification 
¢ Ease and jump-start the qualification process Provides a Warm-and- 
- Review state of the open-source RTOS ease 
¢ What is complete? Tested? 
¢ What holes are missing? What needs tested? 
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Nasal Research Goals JSPR 


GSFC Flight Software Open Source Flight Software Stack 
¢ Completely Open Source Flight Software 

¢ “Qualifiable” due to this research 

¢ Applicable to both small and large NASA missions 


NASA Mission Flight Software 
Mission Specific 


Open Source 


SWROh eas Oler-lilileciarela 
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Nasal Research Tasks JSPR 


¢ Task 1: Find DO-178B and 7150.2B Overlap () 


¢ Task 2: Review Overlap and Trim to Core Artifacts () 


Core Artifacts 


¢ Task 3: Generate Core-Artifacts-List () 


¢ Task 4: Apply Core-Artifacts-List to Open-Source Project () 
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Core-A rtifa cts-List crn a 


Software Requirements 
Specification 
Requirements Test and 
Traceability Matrix 


Artifact Intent ‘ : : 
Wecamenistonci colwae ¢ Provides a pre-qual starting point 


quirements e Friendly names 


aintain bidirectional traceability J 
Getween the software requirement ¢ Should not be SUrPFISINg 


and the higher-level requirement. ° Catego ry-b ased 
Software Assurance equirements validation to ensure 


Plan / Validation tat the software will perform as ° “Hidden” pre-qual with focus on 


environment. 


Requirements 


Design and Software Development Software Test Plan 


Implementati§@n | or Management Plan 


Th@ Software Development Plan Testing and 
inciudes the objectives, standards Software 
life cycle(s) to be used in the Assurance 
ware development process. Activities 
dentify and control major 


ocument describing the testing 
scope and activities. 

o define the techniques, 
ocedures, and methodologies that 
ill be used. 


Software Assurance / 
Testing Procedures 


Software Configuration 


Management Plan ipvare changes, ensure that Software Change eviews of software activities, 
qe 's — ji h , Report and Problem satus, and results with the project 
pened) ale tepolt eneaniges 0 Report gakeholders and track issues to 


other personnel or clients who 
ay have an interest. 

mement the software design into 
2 which is maintained in a 

ion control system. 

are coding methods, 

dards, and/or criteria are 

ered to and verified. 

ument that provides release 
mation including versions, 

ge history, and dependencies. 


psolution. 

roject milestone and schedule is 
pdated accordingly. 

fmecord, address, and track to 
@osure the results of software 
prification activities. 


: Software Schedule 
Implementation 


Software Test Report / 
Verification Results 


Coding Standards 
Report 


Version Description 
Document (VDD) 


Usability Software User’s Software User Instructions 


Manual 
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¢ Task 4: Apply Core-Artifacts-List to Open-Source Project 
¢ Chose RTEMS 


Applicable to RTEMS SEG 


Embedded With 


RTEMS 


www.rtems.com 


Significant NASA / ESA flight heritage 

Professional, well-managed open-source project 
Desires to incorporate pre-qualification into their open-source 
process — but can’t be a burden — wants a lightweight process 


Has some existing processes, tests, documentation in place 
“RTEMS Software Engineering Standards” Template 


1. Introduction to Qualification / Purpose 
2. Software Development Management 
a. Implementation Details 
b. Coding Standards 
c. Change Management 
d. Issue Tracking 
3. Software Test Plan Assurance and Procedures 
a. Scope, Procedures, Methodologies, Tools 
4. Software Release Management 
a. Software Change Report Generation — 


Review process, workflows, etc 


b. Version Description Document generation 


(generated by Issue Tracker) 
5. User’s Manuals 
. Licensing Requirements 


: TAR 


SOFTWARE 
TESTING & RESEARCH LABORATORY 


Applicable to RTEMS J 


“RTEMS Software Engineering Standards” Template 
Introduction to Qualification / Purpose ys 


Software Development Management 
a. Implementation Details 
b. Coding Standards WA 
c. Change Management 


d. Issue Tracking 


Next Steps 
¢ Dive into more details 
¢ Provide scorecard on areas 


that can be improved 
Software Test Plan Assurance and Procedures - Leverage open-source tools 
a. Scope, Procedures, Methodologies, Tools to generate artifacts 
Software Release Management ¢ Think about requirements 
a. Software Change Report Generation — more 
Review process, workflows, etc J 


manny 


b. Version Description Document generation 


(generated by Issue Tracker) 
User’s Manuals 
Licensing Requirements J 
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¢ REST is a virtual environment with LEON3 instruction set simulator 

¢ Goal will be a basic set of checkout tests and suitable for pre- 
qualification testing 

¢ Repeatable test results 


Pre-Qualification Space Profile 


LEON3 
(WFIRST uses LEONA) 


0) \e) 
Xilinx Spartan6 


Virtual Virtual 


J 
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Ongoing FY18 Work 


¢ Continue working with RTEMS community on pre-qualification 


¢ Investigate RTOS security and how to assess 


How much should we care about embedded RTOS 
security? 


¢ Mature cFS CryptoLib and Release 


CryptoLib implements SDLS procedures and allow for easy 
integration into existing CFS command ingest and telemetry 
output applications 


Integrate into NOS3 — http:/Awww.nos3.org 
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